Causal interactions and delays in a neuronal ensemble 
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We analyze a neural system which mimics a sensorial cortex, with diflterent input characteristics, 
^ • in presence of transmission delays. We propose a new measure to characterize collective behavior, 

^ ' based on the nonlinear extension of the concept of Granger causality, and an interpretation is given 

, of the variation of the percentage of the causally relevant interactions with transmission delays. 
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■ I. INTRODUCTION 

c ■ 

C/3 ' Orientation selectivity and perception are connected with the collective behavior in neural ensembles Q, Q. Pre- 
^ vious work has shown that networks of excitatory and inhibitory leaky integrate-and-fire neurons tend to oscillate 
^ ; ■ under some general conditions Q, provided that the excitatory neurons receive a sufficiently large input, while other 
. studies have shown how oscillatory activity depends on the spatiotemporal properties of the external input (3| . Due 
' to the finite-velocity propagation of action potentials and to the spike generation dynamics, the presence of delays 
I , is physiological in networks of neurons. Sometimes delays are seen as an annoying presence and are thus neglected. 
' O ' In other studies is shown that they can give rise to a wide gamma of behaviors also groups of neurons with 
reproducible time- locked but not synchronous firing patterns have been individuated 0- Furthermore, the role of 
synchronization is controversial. Undoubtedly, when this phenomenon is limited to a small time interval, it is the 
index of something going on. On the other hand, when facing a fully synchronized network, is difficult to extract any 
kind of information when all the neurons behave as a single one. We try then to get a better insight on this issue 
'TT starting from the idea that the essence of collective behavior is the presence of causal interactions. We thus want to 
, individuate the causally relevant relationships between the neurons in the network. The notion of Granger causality 
' between two time series examines if the prediction of one series could be improved by incorporating information 
' of the other. In particular, if the prediction error of the first time series is reduced by including measurements from 
0^ the second time series, then the second time series is said to have a causal influence on the first one. The interactions 
between individual neurons in a network are nonlinear. We thus propose a radial basis function approach to nonlinear 
Granger causality Q, and show how these causal influences are related to the input signal and to the internal delays. 



II. THE MODEL 



B 

' Our network is a basic model of a mammal cortex, similar to the one in Q, and consists of Ne = 400 excitatory 

^ , neurons and Nj = 100 inhibitory neurons. Each excitatory neuron is connected to 50 random neurons, both excitatory 

O ■ and inhibitory, while each inhibitory neuron is connected to 50 excitatory random neurons. 

' The membrane potential of a LIF neuron satisfies: 

> ' 
• 1—1 . 

^^~{v{t)-K)+m, (1) 



where the membrane resistance is normalized to one. Every time, when the potential of the neuron reaches the 
threshold value Vth, a spike is fired. This resets the potential to the rest potential Vr and remains bound to this value 
for an absolute refractory period Tref- Each inhibitory neuron j (j = 1 . . . Nj) receives an input Ij{t): 

I,it)^^, + r^,{t) + STE,Jit), (2) 



which consists of a constant base current /i, internal Gaussian white noise rj with intensity D, and where ST^jit) 
is the sum of the post-synaptic potentials (PSPs) of the afferent excitatory neurons. 
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On the other end, each excitatory neuron i {i = 1 . . . Ne) receives an input Ii{t): 

hit) ^(1 + ri,{t) + STeM + STj^,{t) + a[^/l~ci,{t) + ^fc^ait)], (3) 

with the same internal current /i and noise rj as in the previous equation, and where STE,i(t) and STi^i(t) are the 
sums of the PSPs of the afferent excitatory and inhibitory neurons, respectively. Furthermore we have an additional 
term Sj{t) = a[y/l — c^j{t) + ^/c^ait)], where £,j(t) and ^g(0 ^-^^ both Gaussian white noise with zero mean and unit 
power. This term mimics an external stimulus. Varying c increases or decreases the degree of spatial correlation of 
the external stimuli, while the total input power to each neuron remains constant. In our model we use dynamical 
depressing synapses, such that PSPs are delivered through synapses whose effective strength is given by the following 
equations 



dz _ z 

dt ~ Tin Tree ' 



(4) 



where x, y and z are the fraction of synaptic resources in the recovered, active and inactive state, respectively, and 
s^(t) is the sum of all the presynaptic activity at time t. Without any spike input all neurotransmitter is recovered 
and the fraction of available neurotransmitter is one: x{t) = 1. After each spike arriving at the synapse, a fraction U 
of the available (recovered) neurotransmitter is released. The fraction y of active neurotransmitter is then inactivated 
into the inactive state z. Tj„ is the time constant of the inactivation process and r^ec is the recovery time constant 
for conversion of the inactive to the active state. 

Furthermore we have inserted time delays in the connections. We performed different simulations, where the delays 
in excitatory (inhibitory) connections were randomly chosen between zero and a maximum value TE,max (ri^max)- 
This maximum value was varied from zero to 40 ms, with a step of 2.5 ms. This values take into account of the 
measurements performed in mammal cortex (lo|. 

We used the following parameter values in the model simulations : Vr—0, Vth—^, Tref—3 ms, Tm—W ms, base 
current /i=0.5, intensity of the internal Gaussian white noise 13=0.08, a— OA (or in case of absence of external 
input), Tin—S ms, T^ec^SOO ms, U{e)—0.5. All simulations were integrated using an Eulcr integration scheme with a 
time step of 0.1 ms. 



III. GRANGER CAUSALITY 



Let {xi}i=i^,^N and {yi}i=i,.,N be two time series of N simultaneously measured quantities. In the following we 
will assume that time series are stationary. We aim at quantifying how much y is cause of x. For fc = 1 to M 
(where M = N — m, m being the order of the model), we denote x^ = Xk+m, X*^ = {xk+m-i,Xk+m-2, ■■■,Xk), 
Y'^ = {yk+m-i,yk+m~2, ■■■,yk) and we treat these quantities as M realizations of the stochastic variables (x, X, Y) 
|14|. Let us now consider the general nonlinear model 

X = wo + wi • F (X) + W2 • S (Y) + W3 • K(X, Y) , , . 



where wq is the bias term, {w} are real vectors of free parameters, F = (ipi^ ipn^) are given nonlinear real 
functions of m variables, S = (i/ji, ...,tpny) are Uy other real functions of m variables, and K = (Cii ••■j Cnx») are 
Uxy functions of 2m variables. Parameters wq and {w} must be fixed to minimize the prediction error (we assume 

M > 1 + 

^-y = igEfeii -wo-wi • F(X^) - W2 • S(Y'=) + W3 • K(X^ Y'^))' . (6) 
We also consider the model: 



x = i;o + vi •F(X), (7) 

and the corresponding prediction error ex- If the prediction of x improves by incorporating the past values of {yi}, 
i.e. exy is smaller than e^, then y is said to have a causal influence on x. We must require that, if Y is statistically 
independent of x and X, then e™ = e^ at least for M oo. For a detailed discussion on how this condition is 
achieved in the present case, see Q and [TH . 
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We choose the functions F, S and K, in model jSJ, in the frame of Radial Basis Function (RBF) methods. We fix 
Tlx = Uy = Uxy = n <C M: n centers {X'', Y''}^^^! the space of (X, Y) vectors, are determined by a clustering 
procedure apphed to data {(X'"', Y'"')}^!^^. To find prototypes we use fuzzy c-means, a well known algorithm which 
introduces fuzzy memberships to clusters, so that a point may belong to several clusters with some degree in the 
range [0,1]: in calculating the center of a cluster the coordinates of each instance are weighted by the value of the 
membership function. We then make the following choice for p = 1, . . . , n: 

^p(X) -expf-||X-XP||V2a2) , 

V'p(Y) =exp(-||Y- Y''||V2ct2^ , (8) 
Cp(X,Y) =^p(X)Vp(Y), 

a being a fixed parameter, whose order of magnitude is the average spacing between the centers. The RBF model 
here proposed can approximate any function of X and Y. We conclude this section stressing that, according to our 
experience, the proposed method is insensitive to details of the clustering procedure used to find prototypes, provided 
that n is at least two orders of magnitude smaller than M . 



IV. RESULTS AND DISCUSSION 



The simulation is run for 30 seconds of model time, such that the network is allowed to stabilize itself, and then 
for further 60 seconds (60000 points). We extracted then 12 time series of length 5000 points, from the PSP of any 
presynaptic neuron, and from the membrane potential of the corresponding postsynaptic neuron. Doing this we take 
also into account the effects of the external input on the subthreshold behavior of the neurons The series were 
checked for covariance stationarity with a Dickey-Fuller test [p < 0.01). The Granger causality algorithm was then 
applied. We identified statistically relevant interactions performing an F-test (Levene test) of the null hypothesis that 
the error on the prediction of one series is not decreased when information on the other series is added to the model. 
This analysis was repeated for every possible delay time in both excitatory and inhibitory connections, up to TE,max 
and Ti^max, and the results were averaged over the 12 trials. 

In absence of external input (ct=0), the percentage of statistically relevant causal interactions decreases slowly but 
uniformly with TE,max and Tj^^nax (Figure H)). 
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FIG. 1: Percentage of causally relevant interactions as a function of the delays of excitatory connections (horizontal axis), and 
inhibitory connections (vertical axis), in absence of external input 

In the presence of spatially uncorrelated external input (c=0), there is some structure in the percentage of causal 
interactions. The major differences are observed varying the delays in the inhibitory connections, with a maximum 
between 20 and 25 milliseconds. This region characterized by an increased amount of relevant interactions becomes 
narrower as the maximum delay in excitatory connections increases (Figure 
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FIG. 2: Percentage of causally relevant interactions as a function of the delays of excitatory connections (horizontal axis), and 
inhibitory connections (vertical axis), in the case of spatially uncorrelated input to the excitatory neurons 

When the external input is spatially correlated (c=l), the structure becomes much more pronounced, this time 
with a maximum around Tj^max =15 ms for TE^max— 0, which becomes narrower and drifts down to Tj^max = 10 ms 
for increasing values of TE,max (Figure |3J). 
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FIG. 3: Percentage of causally relevant interactions as a function of the delays of excitatory connections (horizontal axis), and 
inhibitory connections (vertical axis), in presence of spatially correlated input to the excitatory neurons 

In order to explain the structures that appear in presence of external input, some remarks are in order. A delayed 
inhibitory feedback is necessary in order to discriminate an external input and this explains the lack of causal 
interactions in the absence of delays in the inhibitory connections. Furthermore, if too many inhibitory spikes reach 
an excitatory neuron at the same time, the overall inhibitory effect is depressed. On the other hand, when the delays 
in the inhibitory connections are scattered along a too wide interval, the feedback effect is inactivated. As it concerns 
the delays in the excitatory connections, it is worth to recall that a neuron behaves as a coincidence detector when 
its time constant is small, changing into an integrator when the time constant increases. Since the external input is 
continuous, the information is constantly carried to the inhibitory neurons, and this makes the number of causally 
relevant interaction less sensitive to the value of TE,max- Though, when the input is spatially correlated, the timing is 
more important if we don't want to lose the important information that all excitatory neurons receive the same input 
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at the same time. We observe that the narrowing of the region with highest percentage of causally relevant interactions 
becomes more critical as TE.max increases, remaining optimal only in a small region around a value of Tj „iax for which 
the excitatory neurons are still able to resolve the individual inhibitory spikes. This preferred value in inhibitory 
delays can be useful in choosing the optimal window length in the case of spike-time dependent Dlasticitv|l3||. 



V. CONCLUSIONS 



We have introduced the concept of causality, which can give a better insight on the collective behavior in neural 
systems. We have shown how to extend the original definition of causality to nonlinear systems. We have built a 
basic model of a sensory cortex and performed a quantitative analysis of the causally relevant interactions for different 
characteristics of the external input. 
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